EDS 213 Discussion 2
Data Cleaning
Database #1
Air Quality data
| 2020-01-01 |
Site A |
12.3 |
20 |
15 |
| 2020/02/01 |
Site B |
fifteen |
30 |
20 |
| March 3, 2020 |
Site C |
7.8 |
25 |
twenty |
| NA |
Site A |
9 |
NA |
30 |
| 2020-04-01 |
Site D |
10.2 |
40 |
35 |
Water Quality data
| 01-01-2020 |
River X |
6.5 |
3.2 |
0.05 |
| 2020-02-01 |
Lake Y |
7 |
2.8 |
0.07 |
| 03-03-2020 |
River X |
7.5 |
NA |
0.1 |
| 2020-Apr-04 |
Lake Z |
7.2 |
3.5 |
0.04 |
| 2020-05-01 |
River X |
8.1 |
300.0 |
0.030 ppm |
Database #1 Cleaning
- Standaradize date formats
- Convert PM 2.5 to numeric
- Ensure NAs are actually numeric
- Consistent naming across tables
Database #2
Air quality data
| 2023-04-01 |
08:00 |
City Park |
50 |
25 µg/m³ |
40 |
| 2023-04-01 |
14:00 |
City Park |
55 |
30 |
42 |
| 2023-04-02 |
08:00 |
Industrial Area |
150 |
75 |
60 |
| 2023-04-02 |
14:00 |
Industrial Area |
155 mg/m³ |
80 |
NA |
| 2023-04-03 |
08:00 |
Residential Zone |
40 |
NA |
35 |
Daily weather data
| Park |
14 |
80 |
22 |
60 |
20 |
70 |
16 |
85 |
| Beach |
16 |
85 |
24 |
55 |
22 |
75 |
18 |
90 |
| Forest |
13 |
90 |
21 |
65 |
19 |
80 |
15 |
95 |
| Hill |
15 |
75 |
23 |
50 |
21 |
65 |
17 |
80 |
Database #2 Cleaning
Pivoted Daily Weather data
| Park |
2023.04.01 |
06.00 |
14 |
80 |
| Park |
2023.04.01 |
12.00 |
22 |
60 |
| Park |
2023.04.01 |
18.00 |
20 |
70 |
| Park |
2023.04.01 |
24.00 |
16 |
85 |
| Beach |
2023.04.01 |
06.00 |
16 |
85 |
| Beach |
2023.04.01 |
12.00 |
24 |
55 |
Database #3
Daily air quality data
| 2020-01-01 |
Location1 |
46.69874 |
87.96601 |
98.12719 |
| 2020-01-01 |
Location2 |
119.30424 |
33.44394 |
89.80869 |
| 2020-01-01 |
Location3 |
64.30165 |
35.56292 |
63.59488 |
| 2020-01-02 |
Location1 |
133.03752 |
24.92722 |
88.71676 |
| 2020-01-02 |
Location2 |
141.36776 |
12.69610 |
34.84138 |
| 2020-01-02 |
Location3 |
11.60569 |
18.83068 |
22.21545 |
Yearly vegetation health
| 2020 |
Location1 |
63.01918 |
| 2021 |
Location1 |
83.86073 |
| 2022 |
Location1 |
80.71608 |
| 2020 |
Location2 |
92.40360 |
| 2021 |
Location2 |
42.04080 |
| 2022 |
Location2 |
51.59250 |
Database #3 Cleaning
Yearly Air Quality
| 2020 |
Location1 |
76.88149 |
53.82688 |
69.36883 |
| 2020 |
Location2 |
79.32856 |
54.50517 |
71.14231 |
| 2020 |
Location3 |
74.58713 |
56.02009 |
68.87337 |
| 2021 |
Location1 |
75.65688 |
55.90514 |
68.70571 |
| 2021 |
Location2 |
78.93855 |
52.15081 |
71.25445 |
| 2021 |
Location3 |
77.60456 |
55.07368 |
67.97183 |